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SCHEDULING IN A REMOTE-ACCESS SERVER 
FIELD OF THE INVENTION 

The present invention relates to communication systems and in particular to systems 
for handling remote access connections. 
5 BACKGROUND OF THE INVENTION 

Many providers of communication services employ one or more communication 
servers, such as remote access servers, access routers, and voice over IP gateways. The 
commimication servers may act as modems, Fax handlers, voice over Internet Protocol (V oIP) 
servers and/or may provide any other communication services. 

10 Some communication servers are multi-channel servers which have a capacity to 

concurrently handle a plurality of connections up to a predetermined maximal number. In 
addition, some communication servers, which are implemented mainly in software, for 
example, the servers of 3Com, Ascend, Access, ADI, Connexent, Telogy, and Hothaus, can 
concurrently handle different types of connections. Software based remote-access servers are 

15 generally implemented using a single processor, generally a signal processing processor such 
as a DSP, which is cheaper than a general purpose processor and is more suited for signal 
processing. 

A multi-channel server, using a single processor, generally includes a scheduler which 
determines which channel is handled by the processor at any specific time. Usually, the 

20 channels are organized in a specific order and the processor, periodically, according to a 
scheduling cycle, provides a processing session to each of the channels in the specific order. 

Different connections require processing time, i.e., handling of their received data, at 
different cycle times. For example, the ITU standard G723.1 connection requires handUng of 
its data with a cycle of 30 milhseconds while the ITU standard G729A connection requires 

25 handUng of its data with a 10 millisecond cycle. Some connections, e.g., modem and Fax 
connections, may operate over a large range of data rates and cycle times. All the channels 
must have their data processed during each cycle of their cycle time. A state in which a 
connection is not handled during one of its cycles is referred to as a starvation state. A 
connection which reaches a starvation state is generally disconnected or otherwise suffers 

30 from a degradation of service. 

Some communication servers run on the processor an operating system which performs 
preemption. In such servers the scheduling of the processor to handle data from connections 
with different cycles may be lenient as the processor may interrupt the processing of data from 
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one channel to handle data from another channel. Preemption, however, may require large 
percentages of the resources of the processor and therefore is wasteful. 

Other communication servers limit themselves to connections which are processed 
with a single cycle time. Sometimes such servers are included in an array of servers each of 
5 which handles a different type of connections. 

When a plurality of connections, which require handling of their data at different cycle 
times, are handled by the same server, the scheduler of the server chooses a longest scheduhng 
cycle size of all the cycle times of the connections. Connections which require shorter cycle 
times are handled a plurality of time during each longest cycle rather than once during each of 
10 their own cycles. This, however, may involve degradation of the signals provided by the server 
for those connections, for example increasing their delay beyond allowed limits. 

SUMMARY OF THE INVENTION 
An aspect of some preferred embodiments of the present invention relates to a 
communication server which schedules processing sessions to different connections according 
15 to different scheduling schemes. In a preferred embodiment of the present invention, different 
connections handled by the server receive processing sessions at different scheduling cycles. 
Preferably, in normal operation conditions, the processor performs actual data processing of 
the data of the connections in substantially all the processing sessions. In a preferred 
embodiment of the invention, the scheduler allots processing sessions to connections 
20 according to two scheduling cycles: a short cycle and a long cycle. 

In some preferred embodiments of the present invention, a longest cycle time of 
connections handled by the server is an integer multiple of the cycle times of the other 
connections handled by the server. Preferably, each longest cycle ends together with all the 
other cycles. Preferably, the percentage of time utilization of the server during a plurality of 
25 longest cycles which handle the same connections is substantially the same. Further 
preferably, the order of connections having scheduled processing sessions during a plurality of 
longest cycles which handle the same connections is substantially the same, when the quality 
of service (QoS) of the connections do not change. Thus, a scheduler managing the scheduling 
of processing sessions may determine an order of several connections to be handled one after 
30 the other, such that other modules of the server (e.g., a memory unit) may prepare resources 
for the processing, ahead of time. 

An aspect of some preferred embodiments of the present invention relates to a method 
of determining whether to accept an incoming candidate connection, for handling by a server. 
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The available processing time of the server and the required processing time of the candidate 
connection are determined and compared, and accordingly it is determined whether the 
candidate connection is accepted. In a preferred embodiment of the present invention, a criteria 
by which the server decides if it should accept the candidate connection is whether the 
5 available processing time of the server is larger than the required processing time of the 
connection by at least a safety margin. The safety margin is preferably of a length sufficient to 
prevent starvation of a connection when prevalent changes in the processing times of the 
connections currently handled by the server occur. 

In a preferred embodiment of the present invention, the available processing time is 

10 determined by direct measurement. Altematively or additionally, the available processing time is 
estimated based on the number of connections currently handled by the server and their average 
processing time utiUzation, In a preferred embodiment of the present invention, the determination 
of the available processing time is performed by the server. Altematively or additionally, the 
determination is performed by a router which provides the incoming candidate connections to the 

15 server. 

An aspect of some preferred embodiments of the present invention relates to a 
communication server which determines the order in which it processes data of various 
connections according to their quality of service (QoS). In a preferred embodiment of the 
invention, the order in which a plurality of connections are handled changes while they are 

20 being processed responsive in a change in the QoS of one or more connections. 

There is therefore provided in accordance with a preferred embodiment of the present 
invention, a method of scheduling the handling of data from a plurality of channels, including 
accumulating data from a plurality of channels by a remote access server, scheduling a 
processor of the server to handle the accumulated data from at least one first one of the 

25 channels, once during a first cycle time, and scheduling the processor to handle the 
accumulated data from at least one second one of the channels, once during a second cycle 
time different from the first cycle time. 

Preferably, the first cycle begins concurrently with a second cycle. Preferably, the first 
cycle time is an integer multiple of the second cycle time. Preferably, scheduling the processor 

30 to handle the accumulated data includes scheduling the processor, during the second cycle, to 
handle the accumulated data of substantially all the at least one second channels, before 
scheduling the processor to handle data from any other channels. 
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Preferably, scheduling the processor to handle the accumulated data from the at least 
one first one of the channels includes checking whether the second cycle has elapsed and 
scheduling the processor to handle the accumulated data from one the at least one first one of 
the channels only if the second cycle has not elapsed. Preferably, the at least one first one of 
5 the channels includes a pluraUty of first channels and the at least one second one of the 
channels includes a pluraHty of second channels. Preferably, the scheduling includes 
scheduling the processor to handle the accumulated data of at least one of the second channels 
at least twice before handhng data from at least one of the first chaimels. Preferably, 
scheduling the processor to handle the accumulated data includes allowing the processor to 

10 utihze up to a predetermined amount of processing time of the processor for each channel. 

Preferably, the processor does not run an operating system which performs preemption. 
Preferably, scheduling the processor includes having the processor wait without 
processing data from any of the channels if all the channels were processed during their 
respective current cycles. Preferably, the method includes measuring the amount of time in the 

15 first cycle time in which the processor is waiting and using the measured time in determining 
whether to accept handUng data from an additional channel. Preferably, the scheduling is 
performed without interrupting the processor in the middle of handling accimiulated data from 
a different channel. Preferably, the method includes processing an entire block of accumulated 
data of the scheduled channel responsive to the scheduling. 

20 There is further provided in accordance with a preferred embodiment of the present 

invention, a method of scheduling the handling of a pliu-ality of connections, including 
accumulating data from a plurality of channels by a remote access server which includes a 
processor which does not run an operating system which performs preemption, and scheduling 
the processor to process data from a first one of the channels at least twice, without scheduling 

25 the processor to process data from a second one of the channels, therebetween. 

Preferably, scheduling the processor includes scheduhng the processor to handle data 
from the first one of the channels once during a first cycle time and scheduhng the processor to 
handle data from the second one of the channels once during a second cycle time shorter than 
the first cycle time. Preferably, the method includes processing an entire block of accumulated 

30 data of the scheduled channel responsive to the scheduling. 

There is further provided in accordance with a preferred embodiment of the present 
invention, a remote access server, including a plurahty of channel drivers which accumulate 
data from respective channels, a processor which processes the accumulated data, and a 
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scheduler which schedules the processor to handle accximulated data from a first channel once 
during a first cycle time and data from a second channel once during a second cycle time 
different from the first cycle time, wherein the scheduler does not interrupt the operation of the 
processor while it is processing data from a channel. 
5 Preferably, the scheduler schedules the processor to handle the data from the first 

channel at least twice before scheduling the processor to handle data from the second channel. 

There is further provided in accordance with a preferred embodiment of the present 
invention, a method of determining, by a remote access server, whether to accept an incoming 
connection, including determining an amount of unused processing time of a processor of the 

10 server, and determining whether the amount of unused processing time is sufficient to handle 
the incoming connection. 

Preferably, determining the amount of imused processing time includes determining by 
the processor. Preferably, determining the amount of unused processing time includes 
measuring time in which the processor does not process data from any connection. 

15 Preferably, determining the amount of unused processing time includes estimating the 

amount of time based on a number of connections being handled by the server and/or based on 
the types of the connections being handled by the server. 

Preferably, determining whether the amount of imused processing time is sufficient to 
handle the incoming connection includes determining whether the amount of unused 

20 processing time exceeds an amount sufficient to handle the incoming connection at least by a 
predetermined safety margin. Preferably, the safety margin has a size determined responsive to 
a number of connections being handled by the server. 

There is further provided in accordance with a preferred embodiment of the present 
invention, a method of scheduHng the handling of data, by a remote access server tracking a 

25 short cycle and a long cycle, from a plurality of channels including at least one short cycle 
channel and at least one long cycle channel, including accumulating data from the plurality of 
channels by the server, scheduling a processor of the server to handle the accumulated data 
from all the short cycle channels, determining whether a current short cycle has elapsed after 
scheduling the server to handle the data from all the short cycle channels, and scheduling the 

30 processor to handle the accumulated data from a long cycle channel if the current short cycle 
did not elapse, if there is a long cycle channel which was not processed yet during the current 
long cycle. 
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Preferably, the method includes determining whether the current short cycle has 
elapsed after scheduUng the server to handle the data from the long cycle channel, and 
scheduling the processor to handle the accumulated data from an additional long cycle 
channel, if the current short cycle did not elapse. 
5 Preferably, the method includes waiting, after scheduling the server to handle the data 

from all the short cycle channels, until the beginning of the next short cycle without processing 
data from any channel, if all the long cycle channels were already processed during the current 
long cycle. Preferably, the long cycle begins concurrently with a short cycle. Preferably, the 
long cycle time is an integer multiple of the short cycle time, 
10 There is fiirther provided in accordance vdth a preferred embodiment of the present 

invention, a method of scheduling the handling of a pluraUty of connections, including 
accumulating data from a plurality of channels by a remote access server, determining for at 
least one of the connections a quality of service level, and scheduling the processor to process 
data from the plurahty of connections in an order determined responsive to the determined 
1 5 quality of service level. 

Preferably, the scheduling includes scheduling the processor to handle data from at 
least one first connection before handling data from at least one second connection having a 
lower quaUty of service level than the at least one first connection. 

Preferably, the method includes changing the quaHty of service level of at least one of 
20 the connections while accumulating the data and changing the order of scheduling responsive 
to the change in the quality of service level. 

BRIEF DESCRIPTION OF FIGURES 
The invention will be more clearly understood by reference to the following 
description of preferred embodiments thereof in conjunction with the figures, in which: 
25 Fig. 1 is a schematic illustration of a connection handling server, in accordance with a 

preferred embodiment of the present invention; 

Fig. 2 is a flowchart of the actions performed by a scheduler in the server of Fig. 1, in 
accordance with a preferred embodiment of the present invention; 

Fig. 3 is a schematic time chart illustrating the operation of a scheduler of the server of 
30 Fig. 1, in accordance with a preferred embodiment of the present invention; and 

Fig. 4 is a flowchart of the actions performed by a server in determining whether to 
accept an incoming connection, in accordance with a preferred embodiment of the present 
invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 1 is a schematic illustration of a connection handling server 20, in accordance 
with a preferred embodiment of the present invention. Server 20 comprises a plurality of 
drivers 22, preferably run on processor 28, which accumulate raw data from incoming 
5 connections passing on channels 26. Server 20 may be employed as a stand alone server or 
may be used as part of an array of servers, of the same or different types. The array of servers 
is preferably used vnth a channel router, of any type known in the art, for example, the router 
described in Israel patent application 132,888, fded November 11, 1999, which is assigned to 
the assignee of the present apphcation, and the disclosure of which is incorporated herein by 

10 reference. Preferably, the raw data is accumulated in respective buffers 24 of drivers 22. 
Server 20 includes a processor 28 which processes the received data from each of the 
connections. The processing decodes (and/or performs other processing on) the incoming raw 
data and provides the decoded data on an output 32 of server 20. The data accumulated from 
each channel must be processed within a predetermined time in order to prevent buffer 24 of 

15 its respective driver 22 from overflowing and to ensure proper handling of the connection by 
server 20. A scheduler 30, which is preferably run on processor 28, sets the order in which 
processor 28 schedules processing sessions to the connections, and optionally the durations of 
the sessions. It will be understood that the durations of the sessions for different connections 
may be different. Furthermore, the durations of sessions of a single connection in different 

20 cycles may be different. 

Each connection preferably has an associated cycle time, such that in each cycle the 
connection receives a processing session. It is noted, however, that the connection does not 
necessarily receive the processing session at the same time point within each cycle. In a 
preferred embodiment of the invention, the connections handled by server 20 have either a 

25 short cycle or a long cycle. Preferably, the cycle sizes of the connections are integer multiples 
of each other (e.g., the long cycle is an integer multiple of the short cycle). The cycle 
schedules preferably overiap such that each long cycle begins at the same time as a short cycle 
and contains an integer number of short cycles. In the following description, the connections 
will be referred to according to their cycles, i.e., long cycle connections and short cycle 

30 connections. Scheduler 30 preferably operates a clock which keeps track of the short and long 
cycles. 

Fig. 2 is a flow chart of the actions performed by scheduler 30, in accordance with a 
preferred embodiment of the present invention. At the beginning of each long cycle, scheduler 
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30 marks (50) all the long cycle connections as unprocessed. Thereafter, scheduler 30 
preferably allocates (52) processing sessions on processor 28 to each of the short cycle 
connections, sequentially. 

After all the short cycle connections receive processing sessions, scheduler 30 
5 preferably determines whether (54) any long cycle connections are marked as unprocessed. If 
there is at least one unprocessed long cycle connection, scheduler 30 chooses a long cycle 
connection to receive a processing session (56) and processor 28 processes the data of the 
chosen connection. After the processing of the long cycle connection, scheduler 30 checks 
(58) whether the current short cycle has elapsed. If the current short cycle has elapsed, 

10 scheduler 30 again allocates (52) processing sessions to each of the short cycle connections. If 
(60) the end of the current short cycle ends a long cycle, scheduler 30 marks (50) all the long 
cycle connections as unprocessed before allocating processing sessions to the short cycle 
connections. If the current short cycle has not elapsed (58), another long cycle connection is 
allocated a processing session, if an unprocessed connection exists. Otherwise, processor 28 

1 5 waits (62) until the end of the current short cycle. 

Generally, when scheduler 30 allocates a processing session to a connection, the 
connection utilizes an amount of processing time according to its needs. That is, in different 
cycles the connection may utihze different amounts of processing time. Furthermore, in some 
cycles the coimection may totally forego the processing session it was allocated, and the 

20 scheduler preferably continues by scheduling processing sessions to another connection 
without waiting. 

Preferably, once scheduler 30 allocates the use of processor 28 to a channel, the 
scheduler does not interrupt the processing of that channel until the processing of the channel 
is completed, even if the end of a short cycle has been reached. Further preferably, processor 
25 28 does not run an operating system which performs preemption. 

In some preferred embodiments of the present invention, a maximal limit is placed on 
the processing time which may be used by a connection in a single processing session. In a 
preferred embodiment of the present invention, the maximal processing time used by a 
connection during a processing session is substantially equal to the length of the long cycle 
30 divided by the number of connections handled by server 20. 

Referring additionally to Fig. 3, Fig. 3 is a schematic time chart illustrating the 
operation of scheduler 30 on two short cycle connections (CI, C2) and five long cycle 
connections (C3, C4, C5, C6 and C7), in accordance with a preferred embodiment of the 
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present invention. A long cycle 80, which is for example 20 milliseconds long, includes, for 
example, four short cycles (82A, 82B, 82C and 82D) of 5 milliseconds each. At the beginning 
of each long cycle 80, the two short cycle channels CI and C2 are processed. Thereafter long 
cycle channels C3 and C4 are processed. After channel C4 is processed, short cycle 82A has 
already elapsed. Therefore, channels CI and C2 are again processed. Although the time 
between consecutive processing sessions of channels CI and C2 in cycles 82A, 82B and 82C 
are longer than their cycle the channels do not starve, as they receive a processing session 
during each cycle. 

Two more long cycle channels C5 and C6 are then processed, as there is sufficient 
time to begin their processing before the end of short cycle 82B. After short cycle 82B has 
elapsed, channels CI and C2 are again processed. Afterwards, long cycle channel C7 is 
processed. Since there are no more long cycle channels which were unprocessed, processor 28 
remains idle until the end of short cycle 82C. In short cycle 82D, only channels CI and C2 are 
processed and processor 28 remains idle until the end of long cycle 80. In a next long cycle 80 
this process is repeated. 

As described above, at least one long cycle channel is allocated a processing session (if 
an unprocessed connection remains) during each short cycle. Altematively, scheduler 30 
checks (58) whether the current short cycle elapsed, before checking (54) whether any 
unprocessed long cycle connections remain. In a preferred embodiment of the invention, 
scheduler 30 checks (58) whether the current short cycle elapsed before checking (54) whether 
any unprocessed long cycle connections remain only for the second and later short cycles of a 
long cycle. This is because, if at least one long cycle connection is being handled by server 20, 
it is substantially impossible that the first short cycle (82A) will elapse before the processing 
of one or more long cycle connection begins. 

In a preferred embodiment of the invention, marking (50) all the long cycle 
connections as unprocessed comprises initiahzing the control and status of the channels 
handling the connections. 

In some preferred embodiments of the invention, the short and/or long cycle 
connections are allocated processing sessions in a fixed order such that in all the long cycles 
80 the order of processing is the same. Preferably, the processing order is determined 
according to the quality of service (QoS) levels of the respective connections, such that 
connections with a high QoS are processed before connections with lower QoS. Thus, if due 
to unexpected extreme changes in the processing times required by the connections, one of the 
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connections suffers from starvation, it will then be a connection with lowest QoS. 

The QoS of a connection may change during the handUng of the connection by server 
20. When such a change occurs, the position of the connection in the order of connections to 
be processed in further cycles is preferably adjusted responsive to the change in the QoS. 

In some preferred embodiments of the invention, scheduler 30 keeps track of the 
utihzation level of processor 28. In a preferred embodiment of the invention, scheduler 30 
determines for each long cycle 80, the amount of idle time during which processor 28 is 
waiting (62), i.e., not processing any channel. In addition, scheduler 30 preferably determines 
the idle time 84 in the short cycle which is least utilized, i.e., the last short cycle 82D within a 
long cycle. The determined idle times are preferably used in determining whether an 
additional channel may be handled by server 20. In a preferred embodiment of the invention, 
the idle time during a long cycle 80 is represented as a percentage of the length of the cycle, 
such representation is easily used as a measure of the efficiency of server 20. Altematively or 
additionally, the idle time is represented in absolute times. 

Altematively or additionally to determining the time in which processor 28 is idle, 
scheduler 30 keeps track of the number of connections being processed by server 20 and the 
processing time of each connection. Accordingly, scheduler 30 calculates the current (and 
expected) idle time of processor 28. Preferably, scheduler 30 is notified of any change in the 
processing time utiUzed by one of the connections, so that it can precisely track the idle time 
of the processor. For example, scheduler 30 keeps track of addition and removal of 
connections, changes in the cycle lengths of the connections and changes in the processing 
times of the connections in each cycle. 

In a preferred embodiment of the invention, the idle times are determined based on 
approximations. For example, scheduler 30 may not be able to know the exact processing time 
required by each connection, and instead uses average processing times according to the types 
of the connections (e.g., fax, modem, VoIP). 

Fig. 4 is a flowchart of the actions performed by server 20 in determining whether to 
accept an incoming candidate connection, in accordance with a preferred embodiment of the 
present invention. Preferably, server 20 receives (100) for each of the incoming connections, 
its cycle length, i.e., whether the connection requires processing every short cycle or long 
cycle, and its average required processing time per cycle. Scheduler 30 preferably determines 
(102) whether the idle time during a recent long cycle is sufficient in order to process the 
incoming connection. That is, if the incoming connection is a long cycle connection, scheduler 
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30 determines whether the average required processing time of the incoming connection is 
shorter than the available idle time of the recent long cycle. If, however, the incoming 
connection is a short cycle connection, scheduler 30 preferably determines whether the 
average required processing time multiplied by the number of short cycles in a long cycle is 
5 shorter than the available idle time of the recent long cycle- 
Preferably, if the candidate incoming connection is a short cycle connection, scheduler 
30 also verifies (104) that the idle time 84 of the least utiHzed cycle is longer than the average 
required processing time. If there is enough time to handle the incoming connection, the 
coimection is accepted (106). Otherwise the incoming connection is refused by server 20. 

10 Such refusal may result in a busy signal or in passing the incoming connection to a different 
server by a controlling router. 

In a preferred embodiment of the invention, the method of Fig. 4 is also performed 
when a connection requests to switch from receiving processing time each long cycle to 
receiving processing time each short cycle. Alternatively or additionally, the method of Fig, 4 

15 is also performed when a connection requests to switch from receiving processing time each 
short cycle to receiving processing time each long cycle. In a preferred embodiment of the 
present invention, the method of Fig. 4 is performed when a connection requests to increase its 
processing time utilization during long cycles. Such increase may be due, for example, to 
switching between receiving processing time each short cycle and receiving processing time 

20 each long cycle and/or to a change in the type of the connection (e.g., an increase or decrease 
in the transmission rate of the connection) or due to any other reason. 

In some preferred embodiments of the invention, scheduler 30 accepts an incoming 
connection only if a predetermined amount of reserve processing time will remain after the 
incoming connection is accepted. The reserve processing time is required in case one or more 

25 of the existing connections will require additional processing time. For example, the reserve 
processing time may be used in case an existing connection switches from receiving 
processing time each long cycle 80 to each short cycle 82, or when an existing connection 
requires a longer processing time during each cycle. 

In a preferred embodiment of the present invention, one or more connections may 

30 require processing periods which vary between cycles. Such connections are preferably 
evaluated based on their average utilization. The reserve processing time protects against 
starvation in case the processing utilization temporarily increases during one or more long 
cycles 80. 
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In a preferred embodiment of the invention, the amount of processing time reserved by 
scheduler 30 depends on the number of connections handled by server 20. Alternatively or 
additionally, the amount of reserved processing time depends on the number of handled 
connections which are utiUzing substantially less processing time than a maximal amoimt of 
5 processing time which may be utilized by a connection. In a preferred embodiment of the 
invention, the amount of reserved processing time depends on the number of channels which 
are processed during long cycles 80 and which may be converted to short cycles 82. 

Preferably, if a channel suffers from starvation, the driver 22 of the channel is reset, 
and the connection is thus disconnected. In a preferred embodiment of the present invention, 

10 the amount of reserve processing time is chosen in order to achieve a predetermined chance of 
channel starvation. For example, a user may choose to use a relatively large amount of reserve 
processing time in order to prevent chaimel starvation at the expense of being able to handle 
fewer connections concurrently. Alternatively, a small amount of reserve time is used in order 
to maximize the number of connections handled by server 20 although allowing a higher 

1 5 starvation chance. 

In a preferred embodiment of the invention, the lengths of long cycle 80 and/or of 
short cycle 82 may be changed by a system manager of server 20 when the server is not in use. 
Such a change may include changing the length of long cycle 80 and/or of the nimiber of short 
cycles 82 within a single long cycle 80. Alternatively or additionally, the lengths of long cycle 

20 80 and/or of short cycle 82 may be changed during the operation of server 20. Preferably, 
before changing the length of either of cycles 80 or 82, processor 28 verifies that such a 
change will not cause starvation to any of the connections currently handled by the processor. 

In a preferred embodiment of the invention, all of drivers 22 accumulate the data at a 
common sampUng rate. In an exemplary embodiment, the sampling rate of drivers 22 is 8 

25 kHz, the length of short cycle 82 is 5 msec and the length of long cycle 80 is 20 msec. Thus, 
in each short cycle drivers 22 accumulate 40 samples and in each long cycle the drivers 
accumulate 160 samples. 

It is noted that each connection must receive a processing session during every cycle 
(large or small), but the amount of time between consecutive processing sessions of a 

30 connection may be larger than the cycle. The interval between two consecutive processing 
sessions of a connection may be, under some conditions, close to twice the cycle of the 
connection. Therefore, the largest cycle allowed by a connection is preferably about half the 
largest allowed interval between two consecutive processing sessions of the connection. It is 
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further noted that the time between consecutive processing sessions may be shorter than a 
cycle, for example, when a different connection is disconnected from server 20 or when the 
QoS of one or more of the connections, changes. 

In a preferred embodiment of the invention, each time processor 28 processes a 
5 connection, it processes only a single block including samples accumulated in a single cycle 
(or less if there are only fewer samples), even if more samples have been accumulated in the 
respective buffer 24. Thus, the processing time required to process a connection is 
substantially constant, simplifying the estimation of the processing time required by each 
connection. Preferably, the single block of the connection processed by processor 28 

10 comprises a block of symbols accumulated during a previous cycle of the cycle scheme of the 
connection. Thus, the same data samples of the connection are processed by processor 28 
regardless of the relative time in its cycle in which the processor is scheduled to handle the 
data of the connection. 

Altematively, processor 28 processes substantially all the samples accumulated by 

15 server 22, each time the channel is processed. Further altematively, processor 28 determines 
whether to process all the accumulated samples or only a single block, according to the 
amount of idle time of the processor. In a preferred embodiment of the invention, processor 28 
processes all the accumulated samples of a long cycle connection only for those long cycle 
connections processed during the last short cycle 82D of each long cycle (provided there is 

20 sufficient idle time of the processor). 

Although the above description refers to connections having either a short cycle or a 
long cycle, some preferred embodiments of the invention may be implemented with three or 
more different cycles. 

In some preferred embodiments of the present invention suitable for substantially any 
25 number of different cycles, scheduler 30 (Fig. 1) manages a table which lists, for each channel, 
the cycle of the channel. Each time scheduler 30 must choose a channel to be processed it 
determines, for each channel, the time remaining until the end of the respective cycle of the 
channel. Scheduler 30 preferably chooses the channel which has the least time remaining until 
the end of its respective cycle, provided the remaining time is not longer than the channels 
30 cycle. 

In a preferred embodiment of the present invention, the table of scheduler 30 lists the 
QoS of each channel. Preferably, when a plurality of channels have the same (shortest) time 
remaining until the end of their respective cycle, the processor is preferably scheduled to 
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process the channel with the highest QoS. In a preferred embodiment of the present invention, 
when two or more channels have the same cycle and the same QoS, the scheduler selects one 
of the channels randomly. Alternatively, scheduler 30 assigns an arbitrary order to each of the 
two or more channels such that the scheduler substantially always schedules the two or more 
5 channels in the same order. Alternatively or additionally, the table of scheduler 30 lists the 
most recent time in which each channel was handled. When a plurahty of channels are 
otherwise with equal right for processing, the channel waiting for processing for the longest 
duration, precedes. 

It will be appreciated that the above described methods may be varied in many ways, 
10 including, changing the order of steps, and the exact implementation used. It should also be 
appreciated that the above described description of methods and apparatus are to be 
interpreted as including apparatus for carrying out the methods and methods of using the 
apparatus. 

The present invention has been described using non-limiting detailed descriptions of 
15 preferred embodiments thereof that are provided by way of example and are not intended to 
limit the scope of the invention. Variations of embodiments described will occur to persons of 
the art. Furthermore, the terms "comprise," "include," "have" and their conjugates, shall mean, 
when used in the claims, "including but not necessarily limited to." The scope of the invention 
is limited only by the following claims: 



14 



180/01261 



CLAIMS 

1 . A method of scheduling the handling of data from a plurality of channels, comprising: 
accumulating data from a plurality of channels by a remote access server; 
5 scheduling a processor of the server to handle the accumulated data from at least one 

first one of the channels, once during a first cycle time; and 

scheduling the processor to handle the accumulated data from at least one second one 
of the channels, once during a second cycle time different from the first cycle time. 

10 2. A method according to claim 1, wherein the first cycle begins concurrently with a 
second cycle. 

3. A method according to claim 2, wherein the first cycle time is an integer multiple of 
the second cycle time. 

15 

4. A method according to claim 1, wherein scheduhng the processor to handle the 
accumulated data comprises scheduling the processor, during the second cycle, to handle the 
accumulated data from substantially all the at least one second channels, before scheduhng the 
processor to handle data from any other of the plurality of channels. 

20 

5. A method according to claim 4, wherein scheduhng the processor to handle the 
accumulated data from the at least one first one of the channels comprises checking whether 
the second cycle has elapsed and scheduhng the processor to handle the accumulated data from 
one of the at least one first channels only if the second cycle has not elapsed. 

25 

6. A method according to claim 1, wherein the at least one first one of the channels 
comprises a plurality of first channels and the at least one second one of the channels 
comprises a plurality of second channels. 

30 7. A method according to claim 6, wherein the scheduling comprises scheduling the 
processor to handle the accumulated data from at least one of the second channels at least 
twice before scheduhng the processor to handle data from at least one of the first channels. 
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8. A method according to claim 1, wherein scheduling the processor to handle the 
accumulated data comprises allowing the processor to utilize up to a predetermined amount of 
processing time for each channel. 

5 9. A method according to claim 1, wherein the processor does not run an operating 
system which performs preemption. 

10. A method according to claim 1 , wherein scheduling the processor comprises having the 
processor wait without handling data from any of the channels if all the channels were 
10 scheduled for handling during their respective current cycles. 

IL A method according to claim 10, comprising measuring the waiting time of the 
processor in the first cycle and using the measured time in determining whether to accept 
handling data from an additional channel. 

15 

12. A method according to claim 1, wherein the scheduling of handling the data of one 
channel is performed without interrupting the processor in the middle of handling accumulated 
data from a different channel. 

20 13. A method according to claim 1, comprising processing an entire block of accumulated 
data of the scheduled channel responsive to the scheduling. 

14. A method of scheduling the handling of a plurality of connections, comprising: 

accumulating data from a plurality of channels by a remote access server which 
25 includes a processor which always processes data of a channel without interruption responsive 
to scheduling; 

scheduling the processor to process data from a first one of the channels at least twice, 
with a first interval between the schedulings; and 

scheduling the processor to process data from a second one of the channels at least 
30 twice, with a second interval between the schedulings, which second interval includes the 
entire first interval. 
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15. A method according to claim 14, wherein scheduling the processor comprises 
scheduling the processor to handle data from the first one of the channels once during a first 
cycle time and scheduling the processor to handle data from the second one of the channels 
once during a second cycle time longer than the first cycle time. 

16. A method according to claim 14, comprising processing an entire block of accumulated 
data of the scheduled channel responsive to the scheduling. 

17. A remote access server, comprising: 

a plurality of channel drivers which accumulate data from respective channels; 
a processor which handles the accumulated data; and 

a scheduler which schedules the processor to handle accumulated data from a first 
channel once during a first cycle time and data from a second channel once during a second 
cycle time different from the first cycle time, without interrupting the processor while it is 
processing data from a channel. 

18. A server according to claim 17, wherein the scheduler schedules the processor to 
handle the data from the first channel at least twice before scheduling the processor to handle 
data from the second channel. 

19. A method of determining, by a remote access server, whether to accept an incoming 
connection, comprising: 

determining an amount of unused processing time of a processor of the server; and 
determining whether the amount of unused processing time is sufficient to handle the 
incoming connection. 

20. A method according to claim 19, wherein determining the amoimt of unused 
processing time comprises determining by the processor. 

21. A method according to claim 19, wherein determining the amount of unused 
processing time comprises measuring the amount of time in which the processor does not 
process data from any connection. 
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22. A method according to claim 19, wherein determining the amount of unused 
processing time comprises estimating the amount of time based on a number of connections 
being handled by the server, 

5 23. A method according to claim 22, wherein estimating the amount of time comprises 
estimating based on the types of the connections being handled by the server. 

24. A method according to claim 19, wherein determining whether the amount of unused 
processing time is sufficient to handle the incoming connection comprises determining 

10 whether the amount of unused processing time exceeds an amount sufficient to handle the 
incoming connection at least by a predetermined safety margin. 

25. A method according to claim 24, wherein the safety margin has a size determined 
responsive to a number of connections being handled by the server. 

15 

26. A method of scheduling the handling of data, by a remote access server keeping track 
of a short cycle and a long cycle, from a plurahty of chaimels including at least one short cycle 
channel and at least one long cycle channel, comprising: 

accumulating data from the plurality of channels by the server; 
20 scheduling a processor of the server to handle the accumulated data from all the short 

cycle channels; 

determining whether a current short cycle has elapsed after scheduUng the processor to 
handle the data from all the short cycle channels; and 

scheduling the processor to handle the accumulated data from one of the at least one 
25 long cycle channel if the cTirrent short cycle did not elapse, if there is a long cycle channel 
which was not scheduled yet during the current long cycle. 

27. A method according to claim 26, comprising determining whether the current short 
cycle has elapsed after scheduhng the processor to handle the data from the long cycle 

30 channel, and scheduling the processor to handle the accumulated data from an additional long 
cycle chaimel, if the current short cycle did not elapse. 
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28. A method according to claim 26, comprising waiting, after scheduling the processor to 
handle the data from all the short cycle channels, until the beginning of the next short cycle 
without processing data from any channel, if all the long cycle channels were already 
scheduled during the current long cycle. 

5 

29. A method according to claim 26, wherein the long cycle begins concurrently with a 
short cycle. 

30. A method according to claim 26, wherein the long cycle time is an integer multiple of 
10 the short cycle time. 

31. A method of scheduling the handling of a plurality of connections, comprising: 
accumulating data from a plurality of channels by a remote access server; 
determining for at least one of the connections a quality of service level; and 

15 scheduling the processor to process data from the plurahty of connections in an order 

determined responsive to the determined quality of service level. 

32. A method according to claim 31, wherein the scheduling comprises scheduling the 
processor to handle data from at least one first connection before handling data from at least 

20 one second connection having a lower quality of service level than the at least one first 
connection. 

33 . A method according to claim 3 1 , comprising changing the quality of service level of at 
least one of the connections while accumulating the data and changing the order of scheduling 

25 responsive to the change in the quality of service level. 
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ABSTRACT 



A method of scheduling the handling of data from a plurahty of channels. The method 
includes accumulating data from a plurality of channels by a remote access server, scheduHng 
a processor of the server to handle the accumulated data from at least one first one of the 
channels, once during a first cycle time, and scheduling the processor to handle the 
accumulated data from at least one second one of the channels, once during a second cycle 
time different from the first cycle time. 
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